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Abstract. Rational relations are binary relations of finite words that are 
realised by non-deterministic finite state transducers (NFT). A particular 
kind of rational relations is the sequential functions. Sequential functions 
are the functions that can be realised by input-deterministic transducers. 
Some rational functions are not sequential. However, based on a prop¬ 
erty on transducers called the twinning property, it is decidable in PTime 
whether a rational function given by an NFT is sequential. In this paper, 
we investigate the generalisation of this result to multi-sequential rela¬ 
tions, i.e. relations that are equal to a finite union of sequential functions. 
We show that given an NFT, it is decidable in PTime whether the re¬ 
lation it defines is multi-sequential, based on a property called the weak 
twinning property. If the weak twinning property is satisfied, we give a 
procedure that effectively constructs a finite set of input-deterministic 
transducers whose union defines the relation. This procedure generalises 
to arbitrary NFT the determinisation procedure of functional NFT. 


Finite transducers extend finite automata with output words on transitions. 
Any successful computation (called run) of a transducer defines an output word 
obtained by concatenating, from left to right, the words occurring along the 
transitions of that computation. Since transitions are non-deterministic in gen¬ 
eral, there might be several successful runs on the same input word u, and hence 
several output words associated with u. Therefore, finite transducers can define 
binary relations of finite words, the so-called class of rational relations |7l4j . Un¬ 
like finite automata, the equivalence problem, i.e. whether two transducers define 
the same relation, is undecidable [9]. This has motivated the study of different 
subclasses of rational relations, and their associated definability problems: given 
a finite transducer T, does the relation |T] it defines belong to a given class C of 
relations? We survey the most important known subclasses of rational relations. 

Rational Functions An important subclass of rational relations is the class of 
rational functions. It enjoys decidable equivalence and moreover, it is decidable 
whether a transducer is functional, i.e. defines a function. This latter result was 
first shown by Schiitzenberger with polynomial space complexity |I4) and the 
complexity has been refined to polynomial time in M. 

A subclass of rational functions which enjoys good algorithmic properties 
with respect to evaluation is the class of sequential functions. Sequential func¬ 
tions are those functions defined by finite transducers whose underlying input 
automaton is deterministic (called sequential transducers). Some rational func¬ 
tions are not sequential. E.g., over the alphabet E = {a, 5}, the function fswap 




mapping any word of the form ua to au, where u € 1^* and cr € Z", is rational 
but not sequential, because finite transducers process input words from left-to- 
right, and therefore any transducer implementing that function should guess 
non-deterministically the last symbol of ua. Given a functional transducer, it 
is decidable whether it defines a sequential function [S], based on a structural 
property of finite transducers called the twinning property. This property can be 
decided in PTime [3] and therefore, deciding whether a functional transducer 
defines a sequential function is in PTime. If the twinning property holds, one can 
“determinise” the original transducer into an equivalent sequential transducer. 

It turns out that many examples of rational functions from the literature 
which are not sequential are almost sequential, in the sense that they are equal to 
a finite union of sequential functions. Such functions are called multi-sequential. 
For instance, the function fswap is multi-sequential, as fswap = /a U /;,, where 
fa is the partial sequential function mapping all words of the form ua to au 
(and similarly for /{,). Some rational functions are not multi-sequential, such 
as functions that are iterations of non-sequential functions. E.g., the function 
mapping ui#U 2 #...#Un to fswap{ui)... fswap{un) for some separator #, is 
not multi-sequential. Multi-sequential functions have been considered by Chof- 
frut and Schiitzenberger in [5], where it is shown that multi-sequentiality for 
functional transducers is a decidable problem. 

Contribution In this paper, we investigate multi-sequential relations, i.e. rela¬ 
tions that are equal to a finite union of sequential functions. Our main result 
shows that, given a finite transducer, it is decidable in PTime whether the re¬ 
lation it defines is multi-sequential. Our procedure is based on a simple charac¬ 
terisation of multi-sequential relations by means of a structural property, called 
the weak twinning property (WTP), on finite transducers. We show that a finite 
transducer defines a multi-sequential relation iff it satisfies the WTP. We define 
a “determinisation” procedure of finite transducers satisfying the WTP, that 
decomposes them into finite unions of sequential transducers. Finally, we also 
investigate the computational properties of multi-sequential relations and show, 
that, for a natural computational model for word relations, multi-sequential re¬ 
lations correspond to the relations that can be evaluated with constant memory. 

Related Works As already mentioned, multi-sequential functions were consid¬ 
ered in [6] . Our weak twinning property is close to the characterisation of multi¬ 
sequential functions of [5], which is based on analysing families of branching 
paths in transducers. Thanks to the notion of delay between output words, our 
property is simpler and can be decided in PTime, for arbitrary (not necessarily 
functional) transducers. Compared to |6], our decomposition procedure is more 
constructive. It extends the known determinisation procedure of functional trans¬ 
ducers, to multi-sequential relations, and applies directly on arbitrary finite state 
transducers (in [B], the functional transducers are assumed to be unambiguous, 
but removing ambiguity is worst-case exponential). 

Finite-valued rational relations are rational relations such that any input 
word has at most k images by the relation, for a fixed constant k. Finite- 
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sequentiality 

multi-sequentiality 
(for functions) 

functionality 

multi-sequentiality 

finite-valuedness 

P Space 
PTime [3] 

Decidable [B] 
PTime (this paper) 

PSpace [13] 
PTime [T0l3| 

PTime (this paper) 

PTime P|TB] 


Table 1. Definability problems for rational relations given by finite transducers 


valuedness (existence of such a k) is decidable in PTime for rational rela¬ 
tions, and any fc-valued rational relation is equal to a union of k rational func¬ 
tions |l:illfillh| . Equivalence of finite-valued rational relations is decidable uni- 
Clearly, any multi-sequential relation is finite-valued. However, for the multi¬ 
sequentiality problem, it would not have been simpler to assume that the input 
relation is given as a finite union of rational functions, because obtaining such 
as decomposition is costly, and moreover, our property is simpler than the struc¬ 
tural properties of mm that characterise finite-valuedness. 

Finally, finitely-sequential relations have been considered in [T]. They cor¬ 
respond to relations that can be realised by an input-deterministic transducer 
whose accepting states can, at the end of the run, output additional words from 
a finite set. Such relations are much weaker than multi-sequential relations. 

The known and new results of this paper are summarised in Table [l] 

1 Rational Word Relations 

We denote by N the set of natural numbers {0,1,... }, and by V{A) the set of 
subsets of a set A, and by 'Pf{A) the set of finite subsets of A. 

Words and delays Let 17 be a (finite) alphabet of symbols. The elements of 
the free monoid 17* are called words over 17. The length of a word w is written 
|?ii|. The free monoid 17* is partially ordered by the prefix relation <. We denote 
by 17“^ the set of symbols for all cr € 17. Any word u S (17 U 17“^)* can be 
reduced into an irreducible word u by the equations = cr~^a = e for all 

(T £ 17. Let Gs be the set of irreducible words over 17U17“^. The set Gjj equipped 
with concatenation u.v = uv is a group, called the free group over 17. We denote 
by u~^ the inverse of u. E.g. {a~^bc)~^ = c~^b~^a. The delay between two words 
V and w is the element A{v,w) := v~^w £ Gs- E.g., A{ab,acd) = b~^cd. 

Finite automata A (finite) automaton over a monoid M is a tuple A = 
{Q,E,I,T) where Q is the finite set of states, / C Q is the set of initial states, 
r C <5 is the set of final states, and EcQxMxQis the finite set of edges, 
or transitions, labelled by elements of the monoid M. 

For all transitions e = {qi,m, 52 ) £ E, qi is called the source of e, 52 its target 
and m its label. A run of an automaton is a sequence of transitions r = ei ... e„ 
such that for every 1 < i < n, the target of ei is equal to the source of Ci+i. We 
write p Q (or just p q when it is clear from the context) to mean that 

there is a run ei... e„ such that p is the source of Ci, q the target of e„, and 
m is the product of the labels of the e^. A run is called accepting if its source 
is an initial state and its target is a final state. An automaton is called trim 
if each of its states occurs in at least one accepting run. It is well-known that 
any automaton can be trimmed in polynomial time. The language recognised 
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by an automaton over a monoid M is the set of elements of M labelling its 
accepting runs. A A-automaton is an automaton over the free monoid S* such 
that each edge is labelled by a single element cr of A. A A-automaton is called 
deterministic if it has a single initial state, and for all q G Q and a G S, there 
exists at most one transition labelled tr of source q. 

Given two automata Ai and A 2 over a monoid M, their disjoint union A 1 UA 2 
is defined as the disjoint union of their set of states, initial and final states, and 
transitions. It recognises the union of the their respective languages. 

Finite transducers Let E and F two alphabets. A (finite) transducer T from 
E* to r* is a tuple {Q^ E, I,T, fx) such that {Q^ E, I,T) is a finite automaton 
over the monoid E* x F*, called the underlying automaton of T, such that 
ECQxExF*xQ, and /t : T —> A* is the final output function. In this 
paper, the input and output alphabets are always denoted by E and F. Hence, 
we just use the terminology transducer instead of transducer from E* to F*. 

A run (resp. accepting run) of T is a run (resp. accepting run) of its under- 

lying automaton. We write p - > q instead of p —^ q. The relation recognised 

by T is the set |Tl of pairs (u, w/xit)) such that i t for i € / and t gT. A 
transducer T is functional if |7^ is a function. It is called trim if its underlying 
automaton is trim. The input automaton of a transducer is the A-automaton 
obtained by projecting the labels of its underlying automaton on their first com¬ 
ponent. Given a transducer T, we denote by M 7 - the maximal integer |u|, u G F*, 
such that V labels a transition of T 01 v = fx{q) for some q G Q. 

A rational transducer is defined as a transducer, except that its transitions 
are labeled in E* x F*. Rational transducers are strictly more expressive than 

transducers and define the class of rational relations. E.g., by using loops q —^ q, 
a word can have infinitely many images by a rational relation. If there is no such 
loop, it is easily shown that rational transducers are equivalent to transducertj^ 

2 Multi-Sequential Relations 

In this section, we define multi-sequential relations, and give a decidable property 
on transducers that characterise them. 

2.1 Prom sequential functions to multi-sequential relations 

A transducer T = {Q, E, I,T, fx) is sequential if its input automaton is deter¬ 
ministic. A function f : A* ^ B* is sequential if it can be realised by a sequential 
transduceij^ i.e. / = |Tl for some sequential transducer T. 

Let E = F = {a,b}. Fig. depicts transducers that implement sequential 
and non-sequential functions. All states which is the target of a source-less arrow 

^ Transducers are sometimes called real-time in the literature, and rational transducers 
just transducers. To avoid unecessary technical difficulties, we establish our main 
result for (real-time) transducers, but, as shown in Remark]^ it still holds for rational 
transducers. 

^ These functions are sometimes called subsequential in the literature. We follow the 
terminology of m- 
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are initial, and those which are the source of an arrow without target, or whose 
target is a word, are accepting. The function fa that maps any word of the form 
a", n > 0, to a^~^b, is sequential. It is realised by the transducer of Fig. 1(a) 


The function fuank replaces each block of consecutive 5 by a single b, but the 
last one. E.g. fuankio-bbbab) = aba. It is sequential and defined by the sequential 
transducer of Fig. 1(b) The function /swap maps any word of the form a”cr to 
era" - - - - • • ’ ' 


for a G S. It is not sequential, because the transducer has to guess the last 
symbol a. It can be defined by the transducer of Fig. |l(c) 


Sequential functions have been characterised by a structural property of the 
transducers defining them, called the twinning property. Precisely, a trim trans¬ 
ducers with initial state go is twinned iff for all states gi, g 2 , all words u,v G S* 


and ui,vi,U 2 ,V 2 G F*, if go 


u\ui 


-t qi 


v\vi 


> gi and go 


U\U2 


-t g2 


V\V2 


-t g2 


then 


A{ui,U 2 ) = A{uiU 2 ,ViV 2 ). E.g., by taking u = v = a, Ui = aa, U 2 = ba and 
vi = V 2 = a, it is easy to see that the transducer of Eig 1(c) is not twinned. 


Theorem 1 (IMS]). Let T be a trim transducer. 

1. T is twinned iff |7^ is sequential. 

2. It is decidable in PTime whether a trim transducer is twinned. 


The following result is a folklore result that we show in Appendix for the sake 
of completeness. It states that the difference (the delay) between the outputs of 
two input words is linearly bounded by the difference of their input words. 

Proposition 2. LeFD be a sequential transducer. For all pairs {ui, vi), {u 2 , V 2 ) G 
I'D}, |zi(z;i,U2)| < Mx,(|Z\('Ui,U 2)| -f 2). 

Multi-sequential relations The function fswap is not sequential, but it is multi¬ 
sequential, in the sense that it is the union of two sequential functions fi , /2 
such that fi is the restriction of fswap to words in a'^a and /2 its restriction to 
words in a'^b. Precisely: 

Definition 3 (Multi-sequential relations). A relation RC E* xF* is multi¬ 
sequential if there exist k sequential functions fi,..., fk such that R = Uti/.- 

The multi-sequentiality problem asks, given a transducer T, whether |T] 
is multi-sequential. It should be clear that the answer to this problem is not 
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always positive. Indeed, even some rational functions are not multi-sequential. 
It is the case for instance for the function f*^ap maps any word of the 
form ... 4i^’U‘n fo fswapi'^i')^fswap{'^ 2 ^^ • ■ ■ ^fswapi'^n)^ where Iti G ^ 

and ^ ^ E is a fresh symbol. This function is rational, as it can be defined by 
the transducer of Fig. |l(d)| In this paper, we investigate the intrinsic reasons 
making a rational relation like /swap multi-sequential and a rational relation like 
fswap not. In particular, we define a weaker variant of the twinning property 
that characterises the multi-sequential relations by structural properties of the 
transducers which define them. 


2.2 Weak Twinning Property 

Definition 4. Let T be trim transducer and qi,q 2 be two states of T. We 

say that qi is weakly twinned to 92 if for all words u,v £ E* and all words 

^ T^* f “l“l '“I’'! “I"2 V\V2 

Ui, It 2 , Vi,V 2 G I , if qi - qi -!• qi -!• 92 - q 2 , or graphically 


V \ Vi V \ V2 


U I Ui 



then A{ui,U 2 ) = Z\(miUi,M 2 U 2 ). 


T satisfies the weak twinning property (WTP) if for any two states qi,q 2 ofT, 
qi is weakly twinned to q 2 . T is weakly twinned if it satisfies the WTP. 


Remark 5. A transducer satisfying the twinning property also satisfies the weak 
twinning property. Indeed, suppose that T satisfies the twinning property. We 
show that in any pattern depicted in Definition|^ we immediately get A[ui , 112 ) = 
A{uiVi,U2V2). Indeed, since T is trim, there exist words {x,x') G E* x P* such 

that go —> qi ) where go is the initial state of T. Then, we have: 

xu\x'Ui xu\x'U2 v\V2 

go- qi — 5 - qi qo -92- qi 


Since T satisfies the twinning property, then A{x'ui,x'u 2 ) = A{x'uiVi,x'u 2 V 2 ), 
and therefore A{ui,U 2 ) = Z\(uiui, 1 x 2 ^ 2 ). 

2.3 Main Result 

We show that the weak twinning property characterises the transducers that 
define multi-sequential relations, and that it is decidable in polynomial time. 

Theorem 6 (Main Result). Let T be a trim transducer. 

1. T is weakly twinned i/f |7^ is multi-sequential. 

2. R is decidable in PTime whether a trim transducer is weakly twinned. 


Deciding the WTP is done with a reversal-bounded counter machine, whose 
emptiness is known to be decidable in PTime m (see Appendix). The proof of 
Theorem 6 [T is done via two lemmas, Lemma and [m that are shown in the 
rest of this paper. An immediate consequence of this theorem and the fact that 
any transducer can be trimmed in polynomial time, is the following corollary: 


Corollary 7. R is decidable in PTime whether a transducer defines a multi¬ 
sequential relation. 
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Remark 8. Theoremis also true when T is a rational transducer. Indeed, if T 

is weakly twinned, then there is no loop of the form q —— > q, otherwise by taking 
qi = q 2 = q, u = V = ui = vi = e and U 2 = f 2 = w in the definition of the WTP, 
one would raise a contradiction. It is easily shown that T can be transformed 
into an equivalent real-time transducer, while preserving the WTP. Conversely, 
if |7J is multi-sequential, then it is finite-valued, and therefore there is no loop 

of the form q ~ — > q. As before, one can transform T into a real-time transducer 
while preserving the WTP. 

Lemma 9. Let T be a trim transducer. If T is weakly twinned, then \T\ is 
multi-sequential. 

Proof. The proof of this Lemma is the goal of Sec. which provides a procedure 
that decomposes a transducer T into a union of sequential transducers. This 
procedure generalises to relations the determinisation procedure of functional 
transducers. In particular, it is based on a subset construction extended with 
delays, and a careful analysis of the strongly connected components of T. □ 

The following lemma is a key result to prove the other direction of Theorem 
|6|1| It states that the WTP is preserved by transducer inclusion and equivalence, 
and therefore, is independent from the transducer that realises the relation. 


Lemma 10. Let 7i,72 be two trim transducers. 

1. If |7i] C 172 ] and T 2 is weakly twinned, then 71 is weakly twinned. 

2. If |7i] = I?!], then 71 is weakly twinned iff T 2 is weakly twinned. 


Proof. Clearly, 2 is a consequence of 1. Let us prove 1 by contradiction. Suppose 
that 71 is not weakly twinned. Hence, it can be shown that there exist two 
states qi and (72 of 71, an accepting run qo —yji qi —^Ti 92 > Ti 9/ and 


u\ui 




\V2 


loops qi - qi - qi and <72 - >Ti 92 such that for every n S N, 

\A{uiVi,U2V2)\ > n (see Lemmain appendix). 

Since 71 is weakly twinned, by Lemma there exist sequential transducers 
Vi,... ,Vk such that [Tl] = Let M = max{\u\, |u|, |? 7 |}. Let b be the 

maximal 1 < z < fc. Let r = Ab{k 7- I)(M -|- 1). For every I < z < fc -|- 1, 

consider the pair {wi,w[) in |71] defined by 


Wi = XV uv 


uv y, 


w\ = X V{ UiV{ 


..uiv{ U 2 V '2 y 


Since |71| C |71], and {wi,w'f) G |71|, we have G [Til, hence there 

exists 1 < j < fc such that {wi, w’f) G |7?j]. As there are k different Vj and k-\-\ 
pairs (wi,w'j), there exist fc > zi > Z 2 > 0 such that G |27j|. 

By Proposition]^ |Z\(zz;'^,zz;'J| < b{\A{wi^,Wi^)\ -1-2). However, 


b{\A{wi^,Wi,^)\ + 2) 

= b\y~^uv'^ ^ ... uv"^ y\ + 2b 

< b\uv^ ^ ... uvy\ + 2h 

= iib\u\ + b\y\ + fehl + 2b 

< b(fc-|-l)(M+l)+2bM(rU-i_i) 




1/ r*l —1 r''2 /i 

— \{U2V2 y) UllJi . . . U2V2 y\ 

> ^ ^ I 

I r^2 + l r^2 /i 

-\uiv^ ... uiv^ U2V2 y \ 

> — b\y\ — b\uv^ ^ ... uvy\ 

> r 1 -^ 


which is a contradiction. 


□ 
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Lemma 11. Let T be a trim transducer. If |T] is multisequential, then T is 
weakly twinned. 


Proof. If |7~] is multi-sequential, then T is equivalent to a transducer T' given 
as a union of k sequential transducers Vi for some k > 0 with disjoint sets of 
states. Clearly, if each Vi is weakly twinned, then so is T'. Since the Vi are 
sequential, they satisfy the twinning property, and therefore the weak twinning 
property by Remark Hence, V is weakly twinned. By Lemma 10 and since 
T~' and T are equivalent, T is also weakly twinned. □ 


The following result implies that, in order to show that a rational relation is 
not multi-sequential, it suffices to exhibit a function contained in that relation, 
which is not multi-sequential. 


Corollary 12. Let R be a rational relation, and f a rational function such that 
f R and f is not multi-sequential. Then R is not multi-sequential. 


Proof. We assume that R and / are defined by transducers T and 7/. The result 
still holds for rational transducers, for the same reasons as the one explained in 



3 Decomposition Procedure 

In this section, we show how to decompose a transducer into a union of sequential 
transducers, via a series of constructions, whenever the weak twinning property 
is satisfied. For simplicity, we sometimes consider multi-transducers, i.e. trans¬ 
ducers such that the function fx maps any final state to a finite set of output 
words. Let T = {Q, E, I,T, fx) be a transducer. Let ~C defined by qi ~ q 2 
if qi and q 2 are strongly connected, i.e. if there exist a run from qi to q 2 and a 
run from <72 to qi. The equivalence classes of ~ are called the strongly connected 
components (SCC) of T. An edge of T is called transient if its source and target 
are in distinct SCC, or equivalently, if there exist no run from its target to its 
source. The condensation of T is the directed acyclic graph >F(T) whose vertices 
are the SCC of T and whose edges are the transient edges of T. A transducer is 
called separable if it has a single initial state and any two edges of same source 
and same input symbol are transient. 

Split Let T = {Q, E, I,T, fx) be a transducer. Let P be the paths of the 
condensation >F(T) starting in an SCC containing an initial state. Note that P 
is finite as E{T) is a DAG. For each path p G P, let Tp be the subtransducer of 
T obtained by removing all the transient edges of E but the ones occurring in 
p. The split of T is the transducer split(T) = [Jp^pEp. Clearly, 

Lemma 13. The transducer split{E) is equivalent to E, i.e. |sp//t(T)] = |Tl. 





If T is separable, then split(T) is a decomposition of T into sequential trans¬ 
ducers. Since any multi-transducer can be transformed into an equivalent union 
of transducers over the same underlying automaton while preserving separability, 
we get the following result (fully proved in Appendix): 

Lemma 14. Let T be a separable multi-transducer with a single initial state. 
Then |7*] is multisequential. 


Determinisation We recall the determinisation procedure for transducers, for 
instance presented in [5]. It extends the subset construction with delays be¬ 
tween output words, and outputs the longest common prefix of all the output 
words produced on transitions on the same input symbol, and keep the remain¬ 
ing suffixes (delays) in the states. Precisely, let T = {Q, E, I,T, fx) be a trim 
transducer. For every U G 'Pf{Q x E*), for every a G E, let 

Ru,(j = {(?; w) G Q X r*\3{p, u) G U, 3{p, a\v, q) G E s.t. w = uw}, 

wu,a be the largest common prefix of the words {rc|3g G Q s.t. {q,w) G Eu^a-}, 

Pu.cr = {{q,w)\{q,wu,aw) G Ru,a}- 


Let I?(T) be the infinite-state multi-transducer over the set of states 'Pf{Q x E*), 
with set of edges {{U, a\wu^a, Pu,<j)\U G Pf{Q x P*),a G E}, initial state Uq = 
I X {e}, set of final states {U G Vf{Q x E*)\U n(T x E*) ^ 0}, and final output 
relation that maps each final state U to {wfT{q)\q G T and {q,w) G U}. Note 
that P{T) has a deterministic (potentially infinite) input-automaton. 

The determinisation of T, written I?(T), is the trim part of E>{T). The trans¬ 
ducer 'D{T) is equivalent to T (see corollary]^ appendix). It is well-known that 
I?(T) is a (finite) sequential transducer iff T satisfies the twinning property. 

Fig. 2(a) I depicts a transducer that satisfies the weak twinning property, but 
not the twinning property. As a consequence, T’(T) is infinite (a part of T){T) can 
be seen on Fig.|2(b)|). The non satisfaction of the twinning property is witnessed 


aaaa\abaa a\a aaaa\baaa a\a 

by the two runs qo - > - > q 4 and qo - > q^ - > q^. Note 

that these runs do not harm the weak twinning property. The idea of the next 
construction, called the weak determinisation, is to keep some, well-chosen, non- 
deterministic transitions, and reset the determinisation whenever it definitively 
leaves an SCC (the SCC {qo, gi, 92 } in this example). We explain this procedure 
when there is a single initial state, as any transducer can be easily transformed 
into a finite union of transducers with single initial states. 


Weak determinisation Let T = {Q, E, I,T, Jt) be a trim transducer with 
a single initial state. For every U G Pf{Q x E*), let the rank njj of U be 
the set containing all the SCC of T accessible from the states q G U. The 
multi-transducer W{T) is obtained from 'D{T) by splitting the edges that do 
not preserve the rank, as follows. If {U,u\v,U') is an edge of I?(T) such that 
njji is strictly included in njj, it is removed, and replaced by the set of edges 
{([/, u\vw, {(< 7 , e)})|(( 7 , w) G U'}- It is easily shown that any pair of distinct edges 


a\vi 


a\v2 


of the form U —^—>■ Ui and U —^—> U 2 in 'W{T) have necessarily been created 
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b I b 



(b) ViT) 


Fig. 2. Non determinisable transducer. 


by this transformation (because without this transformation everything stays 
input-deterministic). Therefore, since the rank strictly decreases S n-u and 
njji C nu) and can never increase in yV’(T), there is no run from U2 to U, nor 
from Ui to U in W{T), and the two edges are transient. As a consequence, 


Lemma 15. The infinite transducer yV{T) is separable. 


The weak determinisation of T, written W{T), is the trim part of W{'T). 


Proposition 16. W{T) andT' are equivalent. Moreover, ifT is weakly twinned, 
W{T) is finite, and it is a multi-transducer. 


The main idea is to prove that, as long as the weak twinning property is 
satisfied, the length of the words present in the states of W{T) can be bounded. 
The proof can be found in Appendix. 


Example 17 . Let us illustrate the weak determinisation on the transducer T of 
Fig. | 2 (a)| Consider the determinisation I?(T) of T of Fig. [ 2 (^ When it is in state 
Ui = {(92, ab), ((73, ba)}, on input a, it moves to state U2 = {(93, aba), (94, 6 aa)}, 
definitely leaving the SCC {90,91,92} of T (the rank nu^ of U2 is strictly in¬ 
cluded in the rank nui of Ui). As a result, this transition is removed from 'D{T), 


i\aha 


\ha 


and replaced by the transitions U2 —^^ 1(93, e)} and U2 —^^ {(94,6)}. The 
resulting transducer W7- is depicted on Fig. 3 (a) (where the new transitions are 
dotted). Fig. | 3 (b)| shows how the latter transducer is split into a union. 


Proof of Lemma We can finally prove that the every weakly twinned trans¬ 
ducer is multi-sequential. Let T = {Q,E,I,T,fT) be a weakly twinned trans¬ 
ducer. Then T is equivalent to where 7 } is the transducer obtained by 

keeping only i as initial state. Given i G I, as we just saw, Wiffi) is a transducer 
equivalent to 7 ). Moreover, as W{7i) is separable, so is >V( 7 )),hence, by Lemma 
[Til it is multi-sequential. The desired result follows. 


4 Application to Multi-Output Streamability Problem 

Sequential functions have the advantage of being efficiently computable. They 
are exactly the word functions that can be evaluated with constant memory in 
a sequential, left-to-right, manner. This computability notion have been defined 
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b I b 



a I baa 


(a) W{T) 


b \ b b \ b 



(b) trim(split(W(r))) 


Fig. 3. Weak determinisation and split 

formally in [S] with the model of Turing transducers. Informally, a Turing trans¬ 
ducer has three tapes: a read-only left-to-right input tape, a working tape, and 
a write-only left-to-right output tape. The amount of memory is measured only 
on the working tape. For any sequential function /, there exists a Turing trans¬ 
ducer M and constant K G N such that for all words u G dom{f), f{u) can be 
computed by M while using at most K cells of the working tape. This model is 
a streaming model in the sense that the input tape is left-to-right, and therefore 
one can think of receiving the input word u as a stream. The converse also holds 
true: any word function computable with constant memory by a Turing trans¬ 
ducer is sequential. Therefore, the following problem, called the streamability 
problem, is decidable in PTime, based on the twinning property: given a func¬ 
tional transducer, does it define a function that can be evaluated with constant 
memory? In this section, we establish a similar result for relations. 

We extend the model of Turing transducer to a model for computing relations. 
We rather explain this model in words, avoiding a tedious and technical definition 
of intuitive concepts. This model can be thought of as a streaming model where 
the input word m is a stream, and the outputs words are produced on-the-fly, 
while processing u, and sent through different channels (represented as output 
tapes in the model). More precisely, let k G N. A k-output Turing transducer 
M is a deterministic Turing machine with (1) a read-only left-to-right input 
tape, (2) a two-way working tape, and (3) k write-only left-to-right output tapes 
without stay transitions (therefore a cell cannot be rewritten). Additionally, the 
machine can disable/enable some output tapes. A tape configuration of such a 
machine is a tuple (u,v,W) where u is the content of the input tape, v is the 
content of the working tape, and W is the set of contents of the enabled output 
tapes. By content we mean the sequence of symbols to the first blank symbol. 

To define the class of constant memory computable relations, we will al¬ 
low some preprocessing of the input stream, i.e., the computation of a constant 
amount of information that can be then exploited by the machine to compute the 
output words. In the setting of sequential function, this information is implicitly 
present in the definition of constant memory computability: it is assumed that 
the input stream belongs to the domain of the function, otherwise it could start 
producing some output word and realise later on that the word was not in the 
domain. The information of being in the domain or not (a 0/1 bit) is typically 
some preprocessing computation that can be performed on the input word, by 
some other application. For instance, if the stream is generated by another ap- 
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plication, this application could also send the information on whether the stream 
belong to the domain of the function or not. 

We come to the definition of constant memory computability for relations. 
Let R C S* X r*. We say that R is constant memory computable if there exist 
two constants k, K G N, a computable function / : If* —>■ {0,1}* such that for 
all u G E*, \f{u)\ < k, and a /c-output Turing transducer M over the alphabet 
ifUTUlO, 1, $} (where $ stand for a blank symbol) such that for all u G E*, on 

initial tape configuration (f{u)^u, e, 0) (all output tapes are initially disabled), 
the machine uses at most K cells of the working tape along its computation, 
and halts in a tape configuration {f{u)#u,a,W) such that W = R{u). 

Theorem 18. Let R C E* x R*. Then R is constant memory computable iff 
it is multi-sequential. Moreover, if R is given by a transducer, it is decidable in 
PTime whether it is constant memory computable. 
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Appendix 


Proofs of section 2 

Lemma 19. Let T = {Q, E, I,T, /t) be a transducer that does not satisfy the 
weak twining property. Then there exists a run 

u\ui v\vi u\u2 v\v2 

qi -^ qi — qi - 92 —92 

such that either |t!i| \v 2 \, or Vi,V 2 e and there is a mismatch between Ui 

and U 2 ■ 

Proof. Suppose that T is not weakly twinned. Then there exists a run 

u\ui v\vi u\u2 v\v2 

qi - qi —!• qi - 92 —92 

such that Z\(mi,M 2 ) 7 ^ Z\(uir'i,M 2 W 2 )- If l^’il 7 ^ |v 2 |, we are done. If |vi| = |u 2|5 
then they are both distinct from e, otherewise Z\(t 6 i,M 2 ) would be equal to 
A{uxVi,U 2 V 2 ). We have to consider three possibilities. 

If there is a mismatch between ui and U 2 ^ we are done. 

If Ml is a prefix of U 2 , suppose ab absurdo that for every n € N, mim" is a prefix of 
U 2 M 2 . In particular, this means that there exist k,k' gN such that U 2 = 
where v'^ is a prefix of ui, and U 2 V 2 = uiv\ v'(, where v'{ is a prefix of vi. How¬ 
ever, as |mi| = |v 2 | by supposition, k' = k + 1 and |mi| = lu"|, hence v'l = v'{. 
Therefore 

Z\(uiMi,'U2M2) = A{uiVi,uiv\'^^v[) = A{e,vlvf) = A(ui,uiv^v[) = A(ui,U2), 


which is a contradiction. 

Therefore there exists n G N such that Mim" is not a prefix of U 2 V 2 . As |uim”| < 
|m 2 V 2 I) there is a mismatch between uim” and U 2 V 2 , hence the run 

UV^\uiV^ v\vi UV^\u2V2 v\v2 

qi -^ qi -^ qi -^ q 2 -^ 

satisfies the desired conditions. 

Finally, if U 2 is a prefix of ui, the desired result can be proved in a similar way. 

Lemma 20. Let T = {Q, E, I,T, fx) be a transducer that does not satisfy the 
weak twining property. Then there exists a run 

u\ui v\vi u\u2 v\v2 

qi -^ qi -^ qi -^ q 2 -^ q 2 

such that for every n G N, \A{uiVi ,U 2 V 2 )\ > n. 

Proof. By the preceding lemma, there exists a run 

u\ui v\vi u\u2 v\v2 

qi -^ qi -^ qi -^ q 2 -^ <?2 
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such that either |r;i| 7 ^ \v 2 \, or vi,V 2 ^ e and there is a mismatch between ui 
and U 2 . 

If l^il < 1 ^ 2 !, we have to consider two possibilities. If luiI < |it 2 |, |Z\(miu", M 2^'2 )l — 
\u 2 V 2 \ — |uiz;"| > n. If |iti| > \u 2 \, by considering the run 

u\ui ^ “ ^“2 I i i“2l I “ l '^2 I ^ v\v2 

qi - qi -)■ qi -S> 92 ->■ 92 , 

we are back in the first situation. 

If |ui| > 1 ^ 2 !, we can proceed in a similar way. 

Finally, if mi, M 2 7 ^ e and there is a mismatch between ui and M 2 , the delay grows 
at each step by |mi| + |m 2 | > 1 , and the result follows. 

Proof of Proposition^ 

Proof. Let p(mi,M 2 ) denote the largest common prefix of ui and M 2 , and let 
d(Mi,M2) and d(M2,Mi) be the words such that mi = p(mi, M2)d(Mi, M2) and M2 = 
p(mi,M 2 )d(M 2 ,Ml). We use similar notations for vi and M 2 . 

As (mi,Mi) and (m 2 ,M 2 ) are recognised by V, there exist two accepting runs 

Pi : q 9 i and p 2 ■ q 92 , where m'i/t(9i) = I'l and M2 /t(92) = '^ 2 - As 

the input automaton is deterministic, each run can be decomposed in two parts 
as follows. 

_ p(ui,U2)\v d(ui,U2)\v" 

Pi ■ q -^ 9-^ 9i, 

_ p{ui,U2)\v d(u2,Ui)\vf 

P 2 ■ q -9 -5- 92- 

Therefore, m is a prefix of both mi and M 2 , hence it is a prefix of p(mi, M 2 ). Finally, 

\^{V1,V2)\ = |d(Mi,M2)| + |d(M2,Mi)| 

= ki| + ^ 2 ! - 2|p(mi,M2)| 

= 2|m| + Im'i'I + \v'f\ + |/r(9i)l + I/t(92)| - 2|p(mi,M2)| 

<KI + KI + l/r( 9 i)l + l/T( 92 )| 

< iWx>|d(Mi, M2)| + Mx>\d{u2, Mi)| + 2Mx> 

= M-p(|A(mi, M2)| + 2). 

Proof of Theorem I6I2I 

Proof. Given a trim transducer T = {Q,E,I,T, fx), we construct a counter 
machine M whose counters are reversal-bounded (they alternate between in¬ 
creasing and decreasing modes only a bounded number of times), such that 
L{M) is empty iff T is weakly twinned. The result will follow since emptiness 
of reversal-bounded counter machine is decidable in PTime m- We base our 
construction on checking the conditions of Lemma |19| 

Let ^ be a fresh symbol that does not belong to E. The machine M will 
be the union of two machines Mi and M 2 that respectively accept words of the 
form uffv such that there exist 91,92 G Q and mi , M 2 , mi , M 2 G P* such that 

u\ui v\vi u\U2 v\V2 

9i -9i -9i -92 ->• 92 

and 
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- \vi\^ |i^ 2 | (for Ml) 

— vi,V 2 ^ e and there is a mismatch between ui and U 2 (for M 2 ) 

Let us explain how to construct Mi. First, to check the property about runs, 
Ml non-deterministically guesses qi and 52 , and will simulate two runs of T in 
parallel on u and v. While reading u, Mi simulates the product of T with itself, 
by guessing two runs of T from the pair of state {qi,qi) to the pair of states 
{qi, 52 )- Similarly, it will simulate two runs of T from the pair (gi, < 72 ) to the pair 
( 91 , 92 ), on V. By simulating these runs. Mi will non-deterministically trigger 
transitions of T, and therefore will guess output words ui,U 2 ,Vi,V 2 . In order to 
check that |ui| ^ |u 2 |, the machine Mi uses two counters ci,C 2 , both initialised, 
non-deterministically, to some value l (by using a loop that increments both ci 
and C 2 , and by non-deterministically deciding to leave that loop). When reading 

•r n /r *1 • • n >-r' r r (l\'W . a\'W . . 

u, it M simulates two transitions of / of the form 9 - > 9 and p - > p m 

parallel, the machine Mi decreases the counters Ci and C 2 from respectively the 
value |w| and |ii;'|. It accepts only if it ends in the pair of states ( 91 , 92 ), ci = 0, 
and C 2 > 0 (meaning that the guessed value t equals |i;i|, and |w 2 | > I'l'iDi or if 
C 2 = 0 and ci > 0 (meaning |z;i| > |i; 2 | = (-)■ Counter machines can only test for 
zero, but this can be easily turned into more complicated tests, such as ci = 0 
and C 2 > 0 , with polynomial space. 

The machine M 2 is constructed similarly. It can easily check that Ui, U 2 ^ e (if 
the transitions of T it simulates in parallel only produce empty words, then the 
machine stays in a non-accepting state). To check the existence of a mismatch 
between ui and U 2 , the machine again uses two counters ci, C 2 both initialised to 
some value i. It will check that l < |ui|, |u 2 |, and that ui[i] 7 ^ U 2 [i\. Like for Mi, 
this is done by decreasing in parallel Ci and C 2 by the length of the respective 
words produced on the simulated transitions of T when reading u. If one of the 
two counters reaches 0 , say ci, then the symbol ui[l] is stored in the state of 
M 2 , and C 2 still continues to be decreased, until it reaches 0. At that point, it 
suffices to check that the symbol U 2 \i\ is different from the stored symbol, and 
to accept only in that case. 

The two machines Mi and M 2 can be constructed in polynomial time from T, 
and therefore have polynomial size. Their counters are reversal-bounded: there 
is only one change of polarity. Therefore, the emptiness of Mi and M 2 can be 
checked in polynomial time (in the size of T). □ 

Proofs of section 3 

Proof of lemma \14\ 

Proof. First, we prove the result for transducers. Let T = {Q,E,I,T,fT) be a 
separable transducer. We shall show that the trim part of split(T) is a decom¬ 
position of T into sequential transducers. Using the same notations as in the 
definition, we have split(T) = [Jp^pTp- Then for every p in P, the input au¬ 
tomaton Ap of Tp has a single initial state. Suppose ab absurdo that Ap admits 
two distinct edges of same source and same label. By supposition, both are tran¬ 
sient edges of T, hence, by definition of Tp, they are part of the path p. However, 
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as they share the same source, the first one encountered by p is not transient, 
which is a contradiction. Therefore Ap is deterministic, hence 7 'p is sequential, 
which proves the desired result. 

The extension to multi-transducers uses the fact that any multi-transducer can 
be transformed in an equivalent finite union of transducers over the same un¬ 
derlying automaton, preserving separability. 

Lemma 21. Given U G Vf{Q,r*) and v G F*, let 

Ru,v = {(?, w) G Q X T*| 3 (p, u) G U,v' G r* s.t. p — — >j- q and w = uv'}, 
wu,v be the largest common prefix of the words {rc| 3 g G Q s.t. {q,w) G Ru,v}, 
Pu,v = {{q,w)\{q,wu,vw) G Ru,v}- 


Then r : U — — Pu,v ‘is the only run of source U and input v in T>{T). 


Proof. This is proved by induction on the length of u. 

li V = a G S, this follows immediately from the definition of the edges of 1 ?(T). 
Otherwhise, v = vga for some non-empty word vq and some letter a G S. 
Suppose that the result is true for vg. Then the only run of source U and input 
Vo in V(T) is 


U 


V0lW[/,^g 


■> Rg,vo ■ 


By definition of the edges of T’(T), the only edge of source Pu^vg and input cr is 


Pu.vg -^ PPu..g,.- 

Hence the only run of source U and input v in 'DifT) is 


U 


^ PPu,^Q,<y 


However, by definition, Ru,v = {(<?)^ RPu,^o,<^}^ Therefore = 
'^u,voWPi,„^,a- and Pu,v = Ppu,^g,cr^ which proves the desired result. 

Corollary 22. The transducer F is equivalent to 1?(T). 


Proof. Let (it, v) G S* x P*. Then 


(u,u) G | 7 ~] there exists an accepting run qg —— >t q s.t. v = wfriq) 
3 q G T, 3 w G r* s.t. {q, w) G Rjjg.u and v = lufriq) 

<^ 3 q gT, 3w' G r* s.t. {q, w) G Pug,u and v = wug,uw'friq) 
^{u,v)GlV{T)l 

where the last equivalence follows from lemma ^T\ 

Corollary 23. The transducer P is equivalent to yV(fP). 
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Proof. Using the definition of 'W{T), and the fact that, by lemma 21 for every 
U G T{Q X r*), for every v G U*, 

{[q,wu,vw)\{q,w) G Pu,v} = (J {(q', w') G P{(q,e)},v}, 

{q,w)eU 


one can prove that WifT) is equivalent to P{T). The result then follows from 
the previous corollary. 

Corollary 24 . Let U G Vf{Q,r*) be the target of a non empty run in VV(T). 
Then the largest common prefix of the words {rcldg G Q s.t. {q,w) G Ru,v} is 
equal to e. 

Proof. By definition of VV(T), either U = {(g, e)} for some q & Q, and the results 
follows immediately, or U is the target of a run in 'D{T), and the result follows 
from lemma [2TJ 


Proof of Proposition^!^ 

Proof. By corollary]^ W{T) and T are equivalent. Suppose that T is weakly 
twinned. We shall show that the subset Q' of Vf{Q x P*) accessible from Uq in 
VV(T) is finite. 

Let Qb be the subset of Q' composed of the elements U G Q' that contain at 
least two pairs {qi,vi), (52,'C2) such that |Z\(wi,z;2)| > 2 M'j-\Q\^. We shall prove 
that Qb is empty, which proves the desired result, as it bounds the size of the 
words present in the sets C/ G Q' : if there were an element U of Q' containing 
a word of size greater than 2 M'i-\Q\^, then it would be in Q', by corollary 

Suppose ab absurdo that Qb is not empty. Let r : Uq —^ V G Qb be a run 

in >V(T) such that for every U G Qb, for every run ru ■ Uq U in W{T), 
the length of r is shorter than or equal to the length of rjj. The run r can be 

11. 7 -r -f r '^ 1 '^ xr 1 x r • i r* 

decomposed into two parts r : Uq - Vg - V where Vq is the first state 

such that the part of the run following it preserves the rank. Therefore, the 
second part of the run is a run of 2 ?(T). Note that either Vq = Uq, or its rank is 
different than the one of its predecessor. In both cases, by definition of VV(T), 
Vq = {{p, e)} for some p G Q. As ny^ = ny, there exists a pair (po, 'Co) in V such 
that there exists a run from po to q in T. Moreover, by supposition, V contains 


T admits three runs 


two pairs (pi,vi), (p2,V2) such that A{vi,V2) > Then, by lemma 
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24 


0 AK . 1 

ro-P^Po - Po -^ • ■ ■ 


-^pS =Po, 


0 “ 1 

n : p = p''{ -)■ Pi 






-^p{ =P 1 , 


0 1 

r2-P = P2 - P2 -^ • ■ • 




Ap'f =P 2 , 


1 _ . Li \Vj 

such that u .. .u^ = u, and for every 0 < i < n, for every 0 < j < 2, p* - > 

p*'*'^ is a transition of T and vj .. .vf = vvj. Then n> \Q\^, because \v\ .. .Vi\ + 
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\v2---V2 \ > A{vi,V2) > 2 M'j-\Q\^ by supposition, and for every 0 < i < n, 
kil + 1^2! — 2M7- by definition of AI-j-. Therefore there exist 0 < ii < 12 < n 
such that for every 0 < j < 2 , = p'’^ . 

If A{vl.. .vl^ .. .V2^) = A{vl.. .vl^,V2 ■ ■ - then 

A{vl. .. .<,^2 ■■■V2) = .. .vl,vl.. .V 2 )> 2 Mr\Q\^, 

hence the run in yV’(T) corresponding to the runs of T obtained by removing 
the part between ii and 12 of ri and r2 is a run strictly shorter than r between 
Uq and an element of which contradicts the minimality of r. 

If A{vl ...vl\vl...V2^)^ A{vl . .U2"), then A{vl.. .vl\v] .. .vf) ^ 

Z\(vg .. .Vq^ ,Vj .. for j = 1 or j = 2 . Moreover, by choice of po, there exists 

a run po p. Therefore there is a contradiction with the fact that T is 

weakly twinned, exposed by taking the runs 


xo\yo 

Po- >P - 

xo\yo 

Po- >P - 

This concludes the proof. 


>p}S 


>Po\ 


Po -;-Po > 

i-i ' J J 

Pn -^ P, ■ 


Proofs of section 4 

Proof of lemma [ 7 ^ 

Proof. If R is multi-sequential, then R = ^ sequential transducers 

Vi,... j'Dk- Let us show that R is constant memory computable, i.e., let us 
construct /, M, K as in the definition of constant memory computability. The 
function / associates with u a word bi.. .bk S { 0 , 1 }* such that 6^ = I iff 
u G dom{'Di). The machine M simulates all the T>i such that bi = 1 successively. 
It uses at most k output tapes to write the output words |I?i](u). It does not 
need to use the working tape (and therefore we can take K = 0) because it can 
simulate the states of Vi by using its internal states. A state of M is therefore a 
tuple of states from distinct Vi. M uses f{u) to initialise the first tuple of states 
lo {Qo)ie{j 163=1}I where Qq is the initial state of Vi. M stops when it reads the 
first blank symbol on the input tape. 

Conversely, let us show that any constant memory computable relation is 
multi-sequential. Let f,k,M,K as in the definition of constant memory com¬ 
putability. Let P = {/(m) I u G A*}. Since for all u G E*, \f{u)\ < k, the 
set P is finite. Given v G P, the machine M reading input of the form vffu 
can be seen as the union of k sequential transducers Vi^y,.. .Vk,v Informally, 
since the memory used on the working tape is bounded by K, there are only 
a constant number of possible configurations on that tape. The states of Vi^y 
are these configurations. Then, the transducer Vi^y simulates M and only pro¬ 
duces the symbols produced by M on the output tape. The accepting states 
of Vi^y are the configurations where M halts. Note that since M can perform 
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several transitions without reading any input symbol, the resulting transducers 
'Di y may have e-transitions. It is easily shown that the 'Di y can be turned into 
proper transducers without e-transitions, as shown in [ 5 ] for constant memory 
computable functions. Finally, we have R = UuGf therefore R 

is multi-sequential. 

□ 


Examples 

Here are two more examples of weakly twinned transducers that are not twinned. 

The figure presents the transducer 7 i along with its determinisation and 
weak determinisation. It is not twinned, as exposed by the runs 

aaaa\a ha\a 

qo -^ 95 -^ 95 , 

aaaa\b ba\a 

9o -!• 95 -^ 95- 

Therefore, the determinisation is infinite. However, the weak determinisation is 
finite. The dotted edge of I?( 71 ), definitely leaving the SCC {90,91,92} of 7 i, is 
split into the three dotted edges of >V( 7 i). The figure exposes the decomposi¬ 
tion of 7 i into a union of sequential transducers. 

The figure present the transducer 72 along with its determinisation and 
weak determinisation. It is not twinned, as exposed by the runs 

aaaaa\baaaa a\a 

9o -96-96, 

aaaaa\abaaa a\a 

9o -96 -96- 

Therefore, the determinisation is infinite. However, the weak determinisation is 
finite. The dotted edge of T’( 72 ), definitely leaving the SCC {qo, 91, 92,93} of 71 , 
is split into the three dotted edges of yV’( 72 ). The figure [ 7 ] exposes the decom¬ 
position of 72 into a union of sequential transducers. 
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(b) ©(Ti) 



Fig. 4. Multisequential transducer that is not sequential. 


20 
































Fig. 5. The transducer trim(split(VV’(7i))) 
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(a)r 


b I ab 



(b) V{T) 


b I ab 



Fig. 6. Multisequential transducer that is not sequential. 
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b I ab 



b I ab 



b I ab 



Fig. 7. The transducer trim(split(VV’(72))) 
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